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CHAPTER I 
INTRODUCTIOtJ 



Asking students to evaluate their teachers' effectiveness 
is both an old idea and a Logical one. Systematic evaluation 
of teachers by. their students is rather widespread at the upper 
^elementary and secondary levels in school* But such evaluations 
have not been easy to obtain at the lower levels of schooling, 
i.e., the primary grades* 1-3. 

Th^Cnew instrument presented in this manual is designed for 
use in securing student evaluations of teachers below the 
^ fourth 4rade level. * This instrument is also thought appropriate 
for use with disadvantaged populations through sixth gtade. 
The instrument is named the Student Evaluation of Teacher II 
(SET II) after its predecessor, the SET i; which is used with 
older 'children^ grades 5 and abpve (Veldman, 1970) . Both 
instruments were dWeloged at The Research and Development 
Center for Teaclier Education; Uppers ity of Texas; Austin, Texas, 
78712. / 

This, manual is larger than the typical instrument manual 
because it repres^ts a certain stance in educational measure- 
ments, namely, the stance that any educator who wishes to 
measure another person for whatever reason should be vitally 



concerned about the nature of the Ineasurement that he is hoping ^ 
to take. Psychological measurement ha^ not reached the state 
of perfection that the Jbhermometer represents in medicine. 

r i " ^ / 

Most psycnblo._^ -cal' ''measures" are quite imperfect, even when they 

i * 

are a distinct improvement over nothing at all. Therefore 

a person' who wishes simply to measure another pers^ w.ithout 

bothering himself about .the nature of the characteristic he is 

Hoping to ^"m^asure" is not beipg realistic al^ut psycholocical 

measurement^ He will undoubtedly be deluded by his results, and 

he may inadvertently damage^his cause, and other persons, more 

'* * ^ 
than 'he helps either. 

This manual attempts to"let the reader in" on the history,' 

nature, and difficulties of the student evaluation of teacliers 

k 

movement. Persons who are interested in the pursuit of student^ 
evaluatic^n ^of teachers are invited to enter into the^total' 
complexity of this- area. Only with the ' cooperation of many, 
interested, concerned persons communicating With each other 
can viable methodologies be developed ^or understanding what it 
is that students can tell us about 'teaching and its ef fSW5r€^upon . 
them. # 

. ^ ' Special Note , ' * 

This ma^iual is complete with the necessary instructions for 
processing SESC^I data in" any school -setting, including .those ' 



which do hot have access, to a computer' and/or lack ^rsonnel 
wi-th' professional expertise in statistics / Where these limiting 
conditions do not prevail, SET II results aire, of course, to be 
computed with standard technological processes. 
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CHAPTER II - ' 

I * ' 

^. THE RATING OF TEACHERS BV 'STUDENTS BELOW «IGH SCHOOL LEV/EL:v^ 

/ " • 

^REASO^TABLENESS, METHODOLOGY, AND RESULTS 

* - — — , " ^ " ^ 

Review of the Literature - " 

' """ ^ ■ ■ *f 

. / ' ' • 
The great length of time that student rating of teachers. 



had been followed as a practicis in this 'country* is surprising,. 
In 1896, Kratz obtained the responses of 2,411 element;aVy 




about teaching. He found', not too unlike *1970,^ that children^ 



like1:J teachers who were encouraging, patient, polifte,^ neat, ^ ' 

and pleasant .(Kratz, 1896) . The^ area of student rating of * . 

1 

teachers subsequently became sa active that the '1931 Review of 

< ♦ » 

Educational Research devoted a whole chapter to "Teacher 

i * 

Rating,*' a chapter followed by S3 references. ' ' ' 

Today*, however, the question of "What makes, a good teacher? 

stil^ lingers on. Partly because of ^e cited age and activity 

of this line of research,, its conf^inuance into the present is' 

' ^ ' \ 

not easy to understand. For fexample, Weintraub points out 

» > *' » 

that research in this area is remarkable for its lack of 

., , , / \ * ■ ; 

sophistication, but the sheer redundancy of the findings leave 
the answer hardly in doubt. Over and over the results of ' 



this- line of inquiry indiaaTT-that students "want'to be understood, 
that they want a sympathetic teacher, that' they want one with 
a sense of humor, and that they want a teacher who can teach 



(wbinWaub,- X9ez^ p. 443)". 



.V 



tha*;e^ are. several reasons for the fact that reseai^ch 
into studepts' peWjeptions of teachers still continues. Weintraub 
hirn'=!elf points out the most obvious one:- "...the state-" ' 
•mei.„s are not so simple as they may seem at first giance. An 
operational definition of an underg.tandirta teacher miqht be 
rathe-r complex^. Indeed, the -concepts of understanding and sy.m- 
pathy are probably interpreted differently by different i'ftdi-' 
yiduals (p. 443) ' , ' - ' - 

Another serious limitation to the " applicability^ of this 
research to praqtice is that the context in which the question . 
about teaching have been asked must be considered. It is not 
simply . ".students" b^ "students in the highly structured situ- 
ation of the school as it has existed'in the last century" who ' 
.have been queries about teaching, * For exantpla, students appear - 
to value, rather highly the ability of the teache^r t4 control the 
class. In a totally different type of school situation, siich 
as- the free school, will this control still ehierge as a valued ' 
teacher attribute? it might. .The point is tha\we simply dG< 
not know. ^' 



■ thi's-line of inquiry indicalT-^t stddents ""want' to be understood, 
that they want a sympathetic teacher, that' they want one with 
a sehje of humor, and that they want a teacher who can teach 



(Wein\raub,- i96?«, p. 443)'. 



• "^^^^^sre.^ several reasons for the fact that reseaijch ' 
•into stiadepts,'. perceptions of teachers "still continues. Weintraub 
hiwself point;5 but the most obvious one;, ••...the state-" ' 

•.ments are not so^simple as they may seem at first glance. An 

\ ' ■ ■ ■ 

operational definition of an upderptandi-ng teacher might be , ' 
rathe'r complex^. Indeed, the -concepts of understanding and sym- 
'pathy are probably interpreted differently b^ different fftdi-' 
yiduals -(p. 443) * ' , - ^ - 

Another- serious limitation to the "applicability, of this- 

research to pra<^i^e is that the context in which the question 

about teaching have been -asked muse be considered. It is not 

,a imply . •■-students" bu:j^. "students in the highly structured situ- 

ation of the school ^s it has existed'in the last^century" who 

,have been queried about teaching. 'For exatttple, students^pVar - 

. . ^ ■^>- 
to value, rather highly the ability of the teacher # control the 

cj-ass. In a totally different type of school situation, such 

as- the free school, will this control still eh,erge as a valued " ^ 



teacher attribute? It might. .The point is tha^^we simply dc< 
not know. ^' 



/'a third limitation o^ this research is that much of it is 



^ther "arm-chaired" or -e^se, at the other extreme, sd inductive 
as" to be totally unorganized. * The discrepancy between the^ two . ^ 
a'pproaches is often glaring. For example, at the lower levels 

Of school grades, inductive remarks Cwhere they are gathered) 

ft 

seem to include many references to dimensions which ^^are absent 
from the usual meaning instrumi .its in this field. For inst^'ce, 
in one report in which the direct interview quotes from young 
children are included (Leeds. 1954). of 42 negative comments 

o ■' ■ ^ 

made about' teachers. 22 bear directly' on teacher • s put-of-control 
emotionality, especially the behavior of^"hX)llering"^ and Vscr^am- 
-ing." (This, is in agreement ■ with the writer's 6wn limited "fest- 



ing^^ '.^.eighborhoqd children, who' invariably refer to "yelling, 
and screaming,") i notable excepti6n to this criticism is Ama- 
tora's Diagnostic Teacher Racing Scale (Amatora. 1950)^- but this 
scale is not designed for Jse below the fourth grade level. 

It is-easy to appreciate the difficulties involved in try- 
ing to correct this "preconceived versus unorganized" aspect of 
teacher-rating measurement.' If the experimenter doe's not begin „ 
with some preconceived dimensions of teacher behavior-, he ends 
with having to logically classify a great number of induct- - 
ive 'remarks. And logical classification tends to 

vary from one experimenter to the next. It is for this 



precise reason that, it is very difficult tp_^o«.h'o„ .uch-. - 
a„„t really does exist in the present ■ literature between 
the varying approaches to' the study' cf^'students ■ views of 
who is the "good teacher". ^ ^ 

: - ^ . 

Reasonableness of nain^ ^ ^.i^ Rese^r^h ' 

The question ^ whether it is, even reasonable to do 
.resea^h in the area of young students' perceptions of teacher 
behavior , rests in large part on wh^her. such students can .. 

discriminate, whether f-Vio-iv- ^ • . . . * 

Whether their discriminations ara Reliable, and 

^ whether their discriminations are valid. " 

can, Young .student s DiscHminate, „uch of the research in 
the area of teacher rating has been carried .ut with students at 
the college or high school level. « that Uvel. data are ea.ier 
gather because verbal ability and ability to follow .instructions 
are not problems. Furthermore, one can assume that such students 
are reasonably capable of making rather mature' disiriminKions 
liietween behaviors* ^ 

Probably many teachers' feel (or like to feel) that young 
students are not capable of making such discriminations. One 
example of this attitude was found in the admonition of such a 
teacher that ..youth should learn from the teacher and disregard 
his fieraonal like or dislike of her. He should get from school 



the things he has come for children have degrees of merj- 
tality . . . .Thefr judgments of teachers are often on a level 
we must ignore" (Wilson, 1948, p. 65).' 

The evidence does not appear to support such a comforting 
rationalization. Of course there are areas in which the views 
of a particular child may not have a-^high- correspondence to 

\ 

reality. In the main, though, it appears that even young -stu- 
dents are able to agrefe in general about what is going on, es- / 
pecially when such^.-observatiions are "kept-"* at .the level of overt 
behavior. 

Amatprd (1952) obtained the ratings of*!/, 000 children in 
\ . ^ / • ■ 

grades 4-8 on seven teachers. The students exhibited markedly 

/ 

*^ifferent degrees of liking for three of the* teachers and re- 
gistered liking to almost an equal degree for the other four. 

iscrlmir 

/ 

evaluation of the individual attribuces of the teachers that they/ 
liked equally well, they still showed a marked ability to 

■ / 

discriminate these same attributes in teachers vhom they L 

/ 

affectively felt quite differently about. For example, they / 

1 

rated a teacher whom they liked collectively at ohly the / ^ 
.02% level as almost equal in "kindness, friendliness, and \ 
understanding" with a teacher whom they liked^ collectively 
at the 65% level. 

The responseF.of 6th graders in minority groups were not 
this discriminating, however, according to Pittman (1952), who 

/ 



Although the students were much more discriminating in their 



found a ae^inue t.ena for evaluation to pile up in the favoraWe 
categories, whether this is aue to real of aiscri™i„at.on. 

reticence to expres. negative- responses to authority figures, or 
■ even an actual high aegree of favorable resp6nsiveness to teachers 
is unclear, .hat minority groups express favorable responses to 
see aspects of school which .ore .iaaie-class chilaren ao not ' 
View so favorably, ana that they ao ..a.e aiscri.initions between' ' 
various attributes of school liS is ae.6nstratea by the attituae 
research of Heale and Prdshek (1967) . ' ' . ' 

Children's aiiri^inatory abilities are indeed (liKe''. 
everyone else's, affected by certain stereotypes ana by 

stimulus qene">'al-i t-. 

g ne^alrzafron. Davrs ana Sloboaian (1967), for example, 

coula fina no overt support for chilaren' s significantly expressed 
beliefs that boys were not allowed as much opportunity to read a- 
girls and that boys r^eived „K>re negative consent fro. the 
eaach.r than girls, aiber and Lewis (1949,.. using a ..T-liK^e test- 
ing situation, concluded that children's perceptions do actually 
reflect the procedures which are carriea out in school., but t,^at 
there is also .uch transference. apparent "in the attituaes of the 
children toward the teachers. In spite of this transference, ^ 
however, they found that children do respond to individual '^Infer- 
ences even within a general pattern of stereotypic behavior: 
this was aemonstrated by the chUdren's differential responses to 



one teacher in a Negro schbol who^e behavior was atypical and * ^ 
did not go Unnoticed as such by the children. Debus (1957) n 
found a significants degree of transference in 5th and 6th 
gra^o students between attitudes toward their- past teachers and 
attitudes toward their present teachers. Cok (1962) even claims ^ 
a significant transference effect between ^attitudes toward .parents < 
and attitudes toward peers*. # . ' ^ . . 



Wright^ and Sherma'n tl96S) were' interested discovering, 
the nature lof those dimensions upon which chiy<frert most- agree 
and±ha^' areas in which they show the highest degree of dis- 
agreyfeiront/ "They doricluded that Lbelre^ i 'ery little ,disagree- ^ 



ment between children in assessing a tetui^aer * s ^competence, but 
the real disagreement between children comes in ^ei^ f^ttempts to, 
assess the teacher's affective feelings ^for themselves/ Wright 
and Sherman's data can be re-analyzed,, however, on the level of 
observation which is calle^^for by the students • One oV'^'tix^^resent 
writers has done this "and finds that the "competence", items are 
generally expressed in very concrete, observable- terms, while 
the "love" items are generally expressed in much more removed, 
motivational terms. In the absence of the concreteness 
expressed in the former class of items, it is natural ,for 
the^'lT^ve" items to lead to more idiosyncratic responses. The • 
interpretations of both Wright and Sherman and the present writer. 



A 



however, are not necess^^ly at variance with>4the actual iktu- 

^/ ' \ * ; ^ 

ation as expressed by the instrument: probably ^the "love" attri- 
butes oE the teacher are much more covertly and individually 
expressed to students than the "competence" attributes of .the^ - 
teacher. It is important to note, however, that even in the 

i ■ ■ 

area of highest individual disagreement — thej love area— 
the children -'as a class can arrive at rather reliable ratings • 
It therefore appears that a fruitful assessment approach in the 
future would consider the "love" or'^ffective ratings of a Itu- 

dent to be highly diagnostic wheji^ these ratings disagree with 

\ ^ . , • 

the mean values the class\ assigned to a teacher. 

To su^arize t];ie:^6^uj.ts of -studied ,cited atpve on young 

children's abilities to discriminate, ^it would seem quite sound 

to presume that these abilities are entirely adequate— on a group 

* ■ ' . 

basis — for assessing the quality of teacher-pupil interaction 

present in a clas'iSrdom. - It would also appear that a valuable 

•J- 

source of diagnostic information on any >ertie pupil, or any sub- 
group of pu^iJfe, would be the degree to which these students 
did not agree with the rating values assigned to a teacher by 
/the ibajority of students , within these students* own group. 

Are Ratings of Young Students Reliable? Ratings of teachers 
by students .at the upper levels of schoolings have proven to be 
remarkably reliable (for example, "The Teacher's Image is 



stubbornly stable,.. Bryan, 1966). Somewhat less is known 
about the reliabil'ity- of such ratings at the lower levels of 
schooling.^ .one classic attempt to resolve this question was 
Amatdra.s -11954, study.oXhe stability .pf ratings of teachers 
done by 1,174 students i^Uth to 8th grades, .matora 
found these raeings jo dg„pV,st)rate both a satisfactory degree 
oi reliab.liiti^^(scri„ina"^k. At the'piesent ti^Tth^re 
is no reason, to suspect; that the ratings of young students 

•ate Sny less reMable than the ratings of' old^ students ' ' 
\ ^ ^ \ ' ' ' ■/ 

Vung studen^correlate,with other' X^eatly valid methods , 
for evaluating^che^s. At the le'vel o( very.young students.- 
not much literature is available on th^ point.'' Teachers 
at the .secondary level seem to feel, ' at least implicitly, that 
studeitt>^:4tings are a valid source of feedback, 'if their will- 
ingness to ch^ge on the basis of such ratings is considered. 
Tuckman and Oliver ,(1968) found that teacher, behavio'r7 »h-icli i,as 
negatively affected by feedback from supervi"sors,- was 'positively 
improved by student feedback. Teaci«rs-,eemed to acknowledge 
the validity of student feedback by their differential reaction, 



to £t. 



Perhaps the research on -.he validity of .i^oung students' 
ratings of £eers can be accepted, 'at least partiaUy, in support 
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of the general validity oi young person's perceptions. Quite 
a bit of evidence (Bonney, 1955; Cannon, 1958? Fine, Fulkerson, 
and Phillips, 1955? Gronlund and Whitney, '1956; Kuhlen and 
Coliister, 1952; and Phillips and DeVault, 1955) exists to 
demp|nst\ate the high validity of' children ' s perceptions as a 
critl^rioii^ taken collectively , of oth^" children's behavior. 
In fact.BoVer (1969) sj:ates^ "If only one methocJ^for class 
'analysis were' permissible, this (a sociome trie in^rument 
completed by children) would undoubtedly be the best single 
procedure (p. 72)". At least for the reasons stated by- Kratz xn 
18^^-". . .those characteristics v/hich impress the pupils 
favorably, which lead, to a high appreciation on their P^^^'^_^ 
and which establish those relations .of sympathy and cooperation 
so Essential in the schoolroom, must have some value. ••(p. 413)" — 
there appears to be no real question of the' validity or useful- 
ness of young children's perceptions of the teacher. 

^ilethodoloqy 

Having established at leait tentatively the reasonable- 
ness of assessing teacher behavior by obtaining young students 
perceptions of it, a next important concern is the discovery of 
suitable methodology for making these assessments. 

At the upper educational levels, ie\is usual to administer 
to the student some type of verbal sc^le^ich describes certain 
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attributes of^ teacher behavior and asks for a student's reactions 
in terms of magnitude of his own fe^ings (for example, the SET, 
Veldman, 1970). Obviously, such an approach presents difficulties 
with very young students who 'of ten cannot read. 

Table 1 summarizes a representative sample of the major 
"methodological approaches which have bfeen used in securing stu-^ 
dent responses to teacher evaluation below the upper high school 
level., ^t is apparent that* scales are rarely used below the - 
fourth grade/''''^S4a?^tteh responses are secured below this l.evelT 
only with gifted students (Barbe and Steiert, 1964) ^ Hhe mdjor 
approaches which have been used with . students below the fourth \ 
grade are TAT-like instruments and interviews recorded by an 
interviewer. Drawings and the Semantic Differential have been 
used infrequently. (Please see Table I for references.) This 
impliej^ that what is known, in an organized fashion , about teacher 
evaluation by students at the lower levels of schooling is- pri- 
marily that information gleaned from the fourth to eighth grades. 
Views of what attributes constitute •^the good' teacher " at the 
very lowest level of schooling, i .e . , the kindergarten and first 
three grades, are in a much more inductive and unquantified con- 
dition. 
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Results * * ' . . * 

Some of the major goals of persons doing researcli, withirt 
the area of student perceptions of teachers have been these: 
(1) the study of the general positivfenfesis' or negativeness of 
student attitudes towards teachers and schools, (^.) the search 
for basic dimensions of teacher behavior which seem to determine 
the positive or negative quality of the student * s attitude to- *, 
ward the teacher, (3)' certain teacher attitudes which . correlate 
with student attitudes toward teachers", and (4) certain student 
outcomes, s'uch as afchievement, which correlate with' either the 
students' views of ttie teacher or t^ teacher's attitudes'. 

The results reported here will concentrate on No. 2 above. ^ 
i.e., the search for basic' dimensions of teacher behavior whicft ■ 
seem to determine the positive o- negative quality of students" . 
attitudes toward teachers. These are the behaviors which will " ^ 
need to be tapped in a new instrument. A few salient teacher 

♦ * 

attitudes (No. 3) related to student opinion will be examined also 
As with the rest of this review, the discussion! will be' confined * 
' mainly to results obtained in studies done with students below ^ 
x.he high schooj. level. . • « 

Rasic Dimensions of Teacher Behavior. The search for major 

dimensions of teacher behavior which appear to determine the \ 

» ■ •■ 

positivene"ss or negativeness of students' attitudes is usually 
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conducted- via the methodology of factor analysis', as we 

shall see below: " ^ 

. .Leading, .efforts to identify important factors in teacher 

behavior are those of RyansUSeO), who identified three major 
factors; -and-Veldman and Peck (1963), who developed a Pupil Ob- 
servation Survey yielding -five major .factors. The fa^ctors of 

♦ * 

Ryans wer,e these: ' (V ^tern Xo= understanding* friendly ver- 
• sui aloof, egocentric, restricted, (2) Pattern Yo - responsible, 
■ businesslike, systen^tic versus evading, unplanned, or sljpshod, 
(3) Pattern- 9;o : stimulating, imaginative, surgenc. or enthusias- 
tic versus dull, routine. The five factors in teacher behavior 
identified by Veldman and Peek were thesei (I) friendly, cheer- 
ful, ' admired; (.2)- poised, knowledgeable: (3) interesting, pre- 
ferni-i: (4) strict control: and (5) democratic procedure, veld- 
man and Feck's subjects were Junior and senior high school students 

- (jWhen Veldman and Peck's P.jpil Observation Survey (POSR) was 
used by White an<? Dekle (1966), at the 5th to 7th grade level, 
six factors" were extracted which these authors called (1) warm, 

' ^ ^ • 10^ f^W considerate; (3) controlled, order- ^ 
affable, deferring/ (2) fair , , consiuei.a 

ly: (4, -surgen-t, ' stimulating: (5) knowledgeable, or^n-minded: ' 
and (er.self-assured,, poised, ego-strength, white and Dekle 
further' divided their 158 Ss into three groups of over-, under-, 
and normally-achieving students. They found a wide difference 



between over- and under-achieving students' behavior on Factor 1 
(and Factor 1 only), which was the students' perception of 
the warmth and affableness of the teacher. 

Another attempt to extrac^the basic dimensions of teacher 
behavior from factor analysis of student ratings was that of 
Paraskevopoulos (1968), who studied teacher ratings in a sample 
of gifted children. Three factors emerged from ttits author's 
factor analysis of Rogge's Style of Teaching Inv^tory: (1) 
friendly, warm; (2) -understanding, flexible? and (3) encouraging 
initative and participation. Paraskevopoulos further discovered 
that these factors related differentially to other teacher char- 
acteristics such as measured by the Myers-Briggs Inventory, for 
example,, sensing, intuiting, feeling, and thinking propensities. 
These results would lead one not to expect all the positive 
"factors" to be present in one teacher. 

Neale and Proshek (1967) used a Semantic Differential in a 
^factor analytic approach with 4th to 6th graders. They also 
discovered three factors, but the first— evaluation—was by 
far the most important one. Their study is important, because a 
part of it wjas done w^ith a culturally disadvantaged elementary 
school population, and they did not find' a generally negative * 
across- the^-board attitude toward teachers or school among these 
children. 



Still another factor -analysis approach to the study of basic 
teacher dimensions as seen by students was done by Beck (1967) using 
his own questionnaire "About My Teacher" with 2,108 sixth grade 
students. He extracted one strong major factor in teacher be- 
havior which, upon analysis, was composed of the following ele- 
ments: (1) warmth and friendliness, (2) ability to communicate 
clearly, and ' (3) motivating qualities. Though Beck's second and 
third factors were statistically less important, they appeared 
to be two separate dimensions of student perception about disci- 
pline: One concerned discipline as reflecting behavior of students, 
and the other concerned discipline as originating from the teacher. 
Beck considers this result of possible importance for future re- . 
search, since it appears to indicate that students, can differen- 
tiate between situational aspects of disciplinary problems. 

A somewhat different approach from factor analysis was taken 
by Amatora (1950), who began the search for major dimensions of 
teacher behavior with' an inductiv6 study that served as the basis 
for the development of a quantified measuring scale. .As cited 
abovfe, Amatora 's approach is closer to the ideal than most. First, 
200 elementary school students were jisked to list traits which 
they liked and disliked in their teachers, A list of 1,500 items 
resulted, from which 300 items were edited into the following 
seven scales: (1) pupil liking for the teacher, '(2) teacher's 
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ability to explain, (3) the sympathetic nature of the teacl^er, . 
(4) fairness, especially in grading, (5) discipline, (6) amount 
of work requi.-ed, and (7) pupil liking for lessons taught iy 
the teacher, ^he final form of these scales was named the Diag- " 
nostic Teacher Rating Scale, with produced reliabilities between 
.72 and .95 in a sample of 1,174 students, and low correlations 
between the separate scales in a sub- sample of 300 studen'ts. Fur 
ther research with the instrument has since" been done in /grades 
4 and above (see Table 1). \ .- ; ' , 

An example of a purely inductive and logical approafch to 

\ 
\ 

the search for dimensions of teacher behavior is that done by 
Barbe and Steiert with gifted children in grades 3.-6 il964) . 
The co-ncern these particular children listed most often (36 out 
of 40 Ss)^kted to the knowledge and wisdom possessed by the 
teacher.' Nejji in importance °(2I out of 40) was the children's ' 
desire for firm class control tempered usually with "fairness" 
or "kindness". These boys wanted a considerate, older woman 
teacher; the girls wanted a teacher who would recognize their 
limits. In short, these gifted children asked for knowledgeable' 
warm teachers— but they were unique of all the studies surveyed 
in putting the dimension of teachfer knowledge first. ' 

In a different approach to the isolation of important teacher 
characteristics, Symonds (1S55) combined a student-nomination 



technique with his own subjective observations of the classroom 
behavior of 17 teachers taken from the top and bottom of 
the student's nomination list. He concluded as follows: (1) 
the superior teachers liked children, and the inferior teachers 
disliked children; (2) the superior teachers were personally 
secure and self-assuredf the inferior' teacher^ were insecure 
and had feelings of inferiority and inadequacy? (3) the superior 
teachers were 'well- integrated and possessed good personality • 
organization; the inferior teachers were personally, disorganized. 
He included anecdotal descl^ptions for all six of his conditions. 

in the above studies which. have been cited as representative 
examples of the quest for basic dimensions of teacher behavior 
that appear to affect children's attitudes positively or nega- 
tively, it is rather difficult to determine (as has been. pre- 
viously discussed in this paper) exactly where agreement and 
disagreement exists. About the clearest result is thi's: almost 
all such attempts find a common result in the primary appearance 
of a teacher behavior usually- referred to as. "warmth and friend- 
liness", in factor analytic studies, this is the usual meaning 
of the^ first factor extracted. 

After the identification of this first factor, results vary. 
(For a visual comparison of some of those results, see Table 2.) 
The practice of naming factors may, or may not, account for 
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variability in results. For example, it is hard to tell ^whether 
one experimenter's factor of '"ability to motivate" is the 

same dimension as the- next experimenter's "lively and interesting?. 
Logically, they appear to be quite the same type of behavior. 

It is a further complication for one interested in knowing 
the teacher characteristics which are appreciated by .younger 
children to note that only one of the studies done with younger , 
children (below 4th grade) appears in any of the "major dimen- 
sions"- results "Hit^d-^ove. Most of the experimenters who stu- 
died young children's attitudes toward teachers were not primarily 
interested in the issue of the "major dimensions" of teaching. 
For example, Gregerson and Travers' study (1968) using a drawing 
technique was concerned Mostly with sex differences in attitudes. 
Davis and Slobodian's study (1967) yas concerned with the accu- 
racy of chl- ^en's perceptions about discrimination against boys. 
Biber and Lewis' study using a TAT-type testing situation was > 
primarily concerned with transference of attitudes in a school 
of lower socioeconomic level, and so. forth. Spillard (1964) did 
logically organize thel^ductive remarks she secured from young 
students into these exhortations to teachers:. (1) smile a bit, 
(2) don't be a lemon, (3) your key word should be justice, (4) 
social attitudes are contagious, and (5) we need effective tea- 
ching methods-. Reanalysis of Spillard' s groups of quotations 



leads one to bfiiieve her first grouping deals with the commonly- 
found dimension of warmth and friendliness; the second is a dis-- 
like of teach^ anger factor; the third grouping is a demand for 
fair but consistent control; the fourth has to do with a desire 
for^ getting one*| s share of personal interaction with the teacher 
(at the level of 'getting to run errands, etc.) — a kind of "atten- 
tional" factor which seems appropriate for such young children 
with the teacher largely viewed as a mother figure; and the fifth 
a rather perceptive demand for more "innovation": i*e., oppori- 
tunity to do things on o'ne * s own, move around, and in general, 
take a larger part in the learning activities. Spillard's N was 
small (20), but her use of direct quotations makes the study pro- 
vocative. ^ 

In conclusion, at' this stage in the research on teacher 
characteristics frdm the pupils *• point of view, the one state- 
ment that can be made with- a high degree of confidence is that 
children of all ages want a warm and friendly teacher who likes 
kids Nowhere is there e-idence to suggest that children do not 
also desire teacher competence, however. Children themselves 
apparently see no contradiction between a strong commitment to 
learning and good mental health conditions in the school (Dunn, 
Bloom, and Morse, 1963). They give indications in almost all 
research cited, though it is not stated with striking verbal 
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agreement from one study to the next, that they want the teacher 
to know something and be able to communicate this knowledge in 
a way -which involves and interests the;... The following, while 

-5. 

an over-slmplication, is a principle which appears supported 
by the literature: the necessary condition of good teaching 
appears to be warmth and friendliness toward children, while the 
sufficient condition of good teaching appears to be competence. 

A Major Teacher Attitude Gestalt Which Appears t o Relate to 
Student-Identified "Warmth and Friendliness" 

Though the major concern of this paper is the ^'investigation 
''of teacher behaviors rather than teacher attitudes and their 
correlates with student opinion, one attitude gestalt identi- 
fied in teachers has appeared in the literature investigated ^ 
with such force that tracking it down may explicate those 
teacher behaviors which pupils regard as "warm and friendly". 
This is the' teacher attitude gestalt of ego-centricity . 

At the conclusion of Ryans * book on teacher characteristic^ 
(1960), he makes the folflowing summary remarks 'about good and 



bad teachers: \ 

There was a general tendency for high teachers 
' to be extremely^ generous in appraisals of the 

\ behavior and /motives of other persons. •.On the 

other hand, low teachers tended generally to be 
restrictive and critical in their appraisals of 
other persons (pp. 397-398) 



w % 

'* Burkard -^962) found very significant differences in the 

TAT sequence analysis of the fantasy productions of teachers 

rated high and low by students using the Diagnostic Teacher- 

Rating^Scale. She states, "...there is a strong contrast 

between what may be designated the active attitude of the high 

group and the passive attitude of the low ". , 

The teachers in the high group constantly reiterate 
■the need of action on' their part to achieve success 
or ta overcome failure. They foresee difficulties 
and recognize; the need of planning and preparation. 
For them success follows on such activity. The low 
group, on the other hand, do not mention these re- 
quirements of success. According to their stories, 
success just comes easily or in some equally un- 
realistic way; or, again it does not come at all 
in spite of constructive, activity on the achiever's 
part. . . 

Toward other people, the high-ranked group ex- 
presses a willingness to go along reasonably., see- 
ing them as good and helpful. The low group, on 
the contrary, sees people either as hostile or as 
friendly in a sentimental way. (p. 285) . 

Burkard (1965) followed this study with another investiga- 
tion of teacher attitudes, again using student ratings as the. 
criterion. The following w^re items' on the Minnesota Teacher 
Attitude Inventory upon which the groups of high and low teachers 
differed significantly (with high teachers on the positive 
end) : teaching never gets monotonous; most pupils are consid- 
erate of their teachers; to maintain good discipline in a class- 
room a teacher does (not) need to be "hardboiled"; the majority 
of children take their responsibilities seriously; most children 



28 



<d 

ERIC 



\ 

\ 



29 



(are courteous) to adults; young people of today are just as 
good as those of past generations? and most pupils try to make 
things easier for their teacher. These are obviously generous, 
other-centered statements. 

Finally, Symonds (1955), as previously cited, found good 
and poor teachers to differ markedly in liking' for students and 
in ego-functioning terms. 

The studies- cited -above contain a remarkable degree of agree- 
n^nt when viewed conceptually from the framework of .ego psychol- 
ogy. The 'warm and friendly teacher who is rated as s-uperior by= 
the students is a mature adult whose focus is outwardly directed 
toward the children and, furthermore, a person who views the 
"children in a very positive and generous, kind of light. The . 
poor teacher appears to be thoroughly ego-centric, concerned 
with herself, interpreting* the students' actions as personally, 
directed toward her" own discomfort, and disposed to impug^the 

motives of others. 

These studies appear important because they help to delimit 
the rather broad conceptual reactioJof students, i.e., the teach- 
er is "warm and friendly," to more definable teacher attitudes 
which precipitate these emotional reactions in students. 
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CHAPTER III 

DEVELOPMENT OF THE STUDENT EVALUATION OF TEACHER (SET II) 

Evidence has been presented on the usual methodology for 
securing teacher ratings at the lower grade levels in school.. (See 
Table 1 in the preceding Review of the Literature section^,) It is 

it 

apparent that scaling techniques have not often been employed' 
below fourth grade, and that the usual procedures for teacher 
rating below this grade have involved one-to-one testing. 

A new teacher rating instrument — the SET II — was designed 
by one of the present writers (Dr. Ruth A. Haak) to assess child- 
ren's views of teachers below fourth grade without the necessity 
for individual testing. The items for this. instrument were modeled 
after items in the "My Teacher" scale developed by Wright and 
Sherman (1965) fromRedl*s leader- tyrant typology. The reasons 

/ 

for selecting items like those of this particular measure were these': 

(1) Wright and Sherman had identified two major dimensions 
elicited by their instrument when used with elementary school 
children: the ''love" dimension and the "competency" dimensipn. From 
the research review presented, thes/two dimensions ^appeared to be, 
at least, the major ones underlying children's judgmejits of teachers 

(2) This instrument might be able to yield both reliable 
mean ratings to be used as criteria of teachers for research 



* 

purposes and diagnostic inforrnsrtion lor* use in. working with 
individual children. in tbe school setting^* This seemed 
'•possible since Wright and Sherman had not only identified 
two major dimensions which children- rate reliably — love and 
competency — but they also discovered that responses^^*€o^some 



items vary sufficiently to yield valuable diagj^KSs tic! information 



2^ the case of children who cfive deviant* responses * 

\ ' r ' *' ' 

with considerable rewording of some of the items .used by 

I 

Wright and Sherman and inclusion of -new value dimensions which 
the literature— SuUgqested were particularily important at loWer 
grades — especially ,\iis like of angry resoons-es ^>nd chance to 

i •- ' V 

interact with teachej — the proposed items for the\iew children's 
teacher rating scale <(SET II) were ^as follows: (the items are 
presented in their hypothesized "groupings," but itoms were 
randomized before presentation) • " 4. 

Assessment of Teacher ^ 
competency Items ; 

1 . 'She teaches us a lot . 

2. Sine is a smart teacher. 

3. We can tell, how she wants things done. 

Love Items ; 

4. The kids like her. 

5. She makes school fun: 

6. She* always picks on people. 



mmm 
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Diagnostic (?) Items : 

7. She helps us a lot. 

8. ^he gets mad a lot, 

9. She listens to what we want. • . 
10^ She gives us^too much v/ork. 

Finally, an innovation in teacher-rating instrumentation 

suggested by Don Veldman (The Set !., Veldman, 1970), was, 

f ' • ' ■ ' 

included, namely a second set of items analogous to thd^e already 

presented which attempted to tap the child's belief about his* 

teacher's supposed attitudes toward himself.- The dimensions 

for this second section were similar to those used to rate^ 

the teacher. This second^ section of the SET IX was admittedly 

partly "projective, •» ©^course, but seemed of especial import-- 

ance in view of the, emphasis that tlie literature review 

had suggested for the teacher's ability ta communicate a 

"generous view" of the student to the student himseTf (see the 

sectipn on Egocentricity , Chapter 2, this manual) . 

This second section of the SET II contained the foliowing 

items; 

t 

Estimation of Teacher ' s Attitude 
Competency Items ; 

.12. She thinks I work hard* * 

13, She thinks I am smart. 
^ *22. She thinks we are a smart class. 

14, *She thinks I can do a lot on my own. 

*Item 22 is -a group form of Item 13. ^ 
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Love Items: 



15. , She likes me. 
*23. She lik'es us kids. 
11. She likes to teach. 
L7. She thinks that kids are good. 



?- Jpiaanostic (?) Itemg : 

18. She likes for me to help her. 

i>c^o-, 19 • She thinks I act ugly. 

^"'^ 20. She thinks I have good ideas. 

21.^ She thinks I |;n lazy. 



^Jitewr2.y IS a group form of Item 15. 

The total of twenty- two items v^re printed upon small 

« 

ca -as with an identifying "stamp" on .the upper right hand 
corner of each card. (See Appendix A for an illustration.) 
The first set of items (Items 1-10) was printed on yellow 
paper, the second set (Items 12-23) on blue paper. 

When the test is administered, the tester orally identi- 
fies each card by its "stamp" to the children. The wording 
of the items is pointed upon the cards merely for its face 
validity value. (Some children can read the wording, of course, 
but the ability to do so is not necessary) . The tester then 
reads the 'item aloud, and .the child classifies the item on each 
card as being true or fa? e by'placing the card in one side of 
a two-sided sorting envelope. On one ,3ide of the sorting 
en\/elope appears the picture of a post-office box: this is where 



/ > • " \ 

\ 

! 

the card is to be placed if the child thinks that what the card 
"says" is true. On the other side of the sorting envelope 
appears*-a picture of a wastebasket: this is where the card is 
to be placed if what the card ''says" is not true/ (See Appendix 
foic a picture of the sorting envelope.) An entire class of 
children ^can be tested at one time by one test administrator. 
The average time involved is about 20 minutes at kindergarten 
and first grade leyel and approximately 10 minutes at grade 
levels above first. 

The first large scale testing for this instrument was 
conducted in the Austin, Texas public schools. Approximately 
1,040 children were involved in a pre-post reliability design. 
This initial testing is reported in the next section. 



CHAPTER IV 

THE STUDENT EVALUATION 
OF TEACHER II (SET II) 

In April, 1971, 1,040 children in grades K-6 in the ^ 
Austin, Texas public scTiools served as subjects for the initial 
pilot study of the 'SET II. This included a test of thc.in- 
s trument * s stability . 

All children were tested in a classroom situation by a 
single test administrator with no other adult (nor the 
teacher) present in the room. The time lapse between testing 
and re-testing was 10 days. In nearly all cases, the testing 
in both administrations was done by the same person. A 
total of four test administrators were involved in the entire 
testing operation. ' v. 

The sample of children involved in this study was pre- 
planned to include a stratified representation of school grades 
and cultural groups. In Austin, Texas, there are three major 
cultural groups: Black, Mexican-American, and White. (Racially, 
jftexican-Americans are classified as "white"; however, important 
cultural differences exist between Mexican-Americans and other 
white groups • In these data, therefore, "white" is under- 
stood to be a classification for all whites oth^r than Mexican- 
American.) 



/ 

/ 



i 



Reliability Study 
Since the SET II is presented in a true-false format, the 



lining reliability wiya these^ da 
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method selected for determining reliability wiUa these) data 

J 

was a percentage of agreement sta^tistic. The percentage of 

agreement (PA) reliability figures for all children for all 

items are presented in the following formats: PA by grade 

only (See Table 3) ; PA by grade with cultural^ group and ability 

level subgroupings (See Tables 4-6) ; and PA by ability level 

1 

within cultural group (See Tables 7-8) . All reli- 
abilities for all items were considered to be adequate at 
this time to justify their continuance in the experimental 
SET II except for the reliabilities obtained at certain ability 
levels within the kindergarten sample. Because of the difficul- 
ties with the kindergarten sample in these data, further 
analyses of the SET II did not include the data from kinder- 
garten children. Use^ of the SET II with kindergarten children 
would presently be recommended only under very limited conditions^ — 
specifically, vith children who are average or above in their 
classroom ability and performance. This instrument in its 
present form does not appear satisfactory for use with lower ^ 



Caution should be used in interpreting the ability-within- 
cultural group PA*s. These data are not from a sufficiently 
large N to justify their acceptance and are presented mostly 
for the hypotheses they may generate. 
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TABLE 3 



Percentage of Agreement Pre to Post: 
Total Sample at Each Grade Level 





., _ . . . I 
in Kinderaarten 


Children 


in First Grade 


1 


86.0* 


1 


89.6 




84 9 / 


2 


92.2 




69.2 


3 


70.1 


A 
H 


89 5 


4 


88.7 


5 . 


74.6 


5 


83.5 




63 0 


6 


78.4 . 


1 


78.0 


7 


86.6 


Q 
D 




8 


69.7 


9 


65.9 


9 


Q 1 "7 
0 1 • / 


10 


63.4 


10 


67.4 


11 


74.6 


11 


86.6 


12 


74.6 


12 


89. 1 


13 


73.9 


13 


91.3 


'14 


69.9 


14 , 


80.5 


15 


81.9 


• 15 


86.6 


16 


87.3 


16 


87.0 


17 


82.7 


17 


89.6 


18 


74.6 


18 


-"80.1 


19 


78.0 


19 


86.6 


20 


67.6 


20 


73.2 


21 


68.2 


21 


79.8 


22 


67.1 


22* 


75.3 


. N 


172 


N = 


231 











TABLE 3 (cent.) 



Second 


and Third Grades 




Fourth- 


■Sixth Grades 






(Mexican American) 


1 


88.4 


• 


1 


79.2 


2 


88.4 




2 


83.6 


3 


, 76.1 






/ D • -J 
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82.7 






84.9 
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83.4 
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79.7 
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80.8 
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by . 4 
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72.8 
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TABLE 6 



Children in Grades 4-6* 
Percentage, of Agreement Pre to Post 



- 


By Ability: 




Variable 


Lov; 


Medium 


High 




Ability 


Ability 


Ability 


1 


■80*.0 


76.7 


81.6 




77 .3 


85.0 


Q "7 C 
O / . D 


3 


67.4 


76.3 


81.3 


4 


82.2 


89.7 


81.6 


5 


79.1 


85.0 


85.7 


6 


79.,1 


77.9 


85.7 


7 


74.4, 


■81.4 


87.8 


8 


62.2' 


63.3 


75.5 


9 


72.7 


77.9 


85.7 


10 


65.9 


80.0 


83.3 


11 


59. 1 


68.3 


79.2 


12 


71.1 


71.9 


89.8 \ 


13 


79.1 \ 


84.5 


83.7 


14 
15 


/72.1 7 
86.7^ 


71.2 
79.7 


87.8 
91.8 


16 


86.4 


95.0 


89.8 


17 


93.0 


91.5 


*98,0- 


i8 


84.1 


83.1 


87.8 


19 


79.5 


77.6 


79.6 


20 


72.1 ^ 


69.0 


89.4 


21 

22 
N 


56.8 
86.0 

45 


71.7 
73.7 

60 


77 .6 
■ 91.8 
49 



*All children in the Grades 4-6 sample are 
Mexican-American • 
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ciBility kindergarten cM.ldren. Oth^^ differences in the 
percentage-of-agreement reliabilities between* cultural groups 
and grade levels did occur; however, these differences, . upon 
examination are generally not marked; the first grade data did 
' not suggest any reason to treat this group separately from the 
rest of the sample, who were older* It appears' that all. 
children in grades 1-3 regardless of ability level or cultviral 
group can use the SET II. to rate teachers in a reliable manner* 

Factor Analy.ges 
A large number of factor analytic studies were performed 
upon the SET II pilot data (See Appendix C) . The procedure used 
provided principal-axis structures and a simple^ structure resulting 
from rotation (Veldman, 1967) The latter structures were exam-- 
ined with the purpose of identifying meaningful dimensions of 
responses • 

Though some suggestive differences between cultural groups 
and grade levels did appear, these differences tended not to 
be marked and to disappear v;ith age. In fact, these differences 
were not sufficient to distort a preliminary factor ana^vsis 

^The SET II is designed for pse in grades 1-3 or 4, since 
the SET I can be used vi^ith grades higher than this. Nevertheless, 

' a large sample of older Mexican American children was available 
in one site, and they were included in this study for purposes of 
testing the feasibility of- the use of the I^ET II with a popula- 

' tion 'Which contained many poor readers. n ' 
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performed upon all these data grouped together, regardless of 
grade (1-3) or .cultural group. The differences which did 
appear were chiefly as follows: 

1. The black children wer-e much more cohesive in their 
evaluations of the teachers' supposed attitudes toward 
themselves than chey were in their own evaluations of 
the teachfA. This t..nding is quite provocative 'and 
suggests ^ number of hypotheses about the way in which ' 
black childi-f-i orient the'ir perceptions. 

2. Mexican-American children tended to be more cohesive 

il, their evaluations of items that^ere emotionally loaded. 
By late elementary school, however, thid difference tended 
^^to disappear and the Mexican-American and other white 
■data were largely indiscernible in this regard. 
■; The major source of error to be contended with in the factor 
analytic- studies, was the high possibility that individual 
■"teacher effects" cou'd be strongly and undesirably afficting' 
the fact9r structure. The final fao )- .studies (reported in 
Tables 9 & 11) were, therefore, pf.-r forir -^d upon teacher mean scores 
for all variables. There wer - ,t;al of 28 teachers .of students 
in g^rades- 1-3 involved in the study; therefotce, data analyzed 
in the major factor ..structure reported in Table 9 are comprised 
of the inean scores for 20 of the original' 22 items for each of 
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teachers in grades 1-3. The factor study in Table 11 included 
all 36 teachers in the sample, those who taught grades 4-6 as 
well as grades 1-3. When the SET II was originally conceived, 
it was hypothesized that responses to the items would statisti- 
cally .group themselves into the following categories: Love, 
Competence, and Diagnostic (items with little logical commonality 
Other than ^their emotional tone, and with high standard deviations) 
The major factor structure whicb resulted from the final analysis 
of the Experimental SET II (teacher mean scores on all variables) 
only partially supported th^se preliminary hypotheses. A dis-- 
. cussion of the* final factor structure accepted for scoring the 
SET II by categorical dimensions follows. 

The Categorical Structure of the SET II 
In this study, there appear to be three relatively stable 
factors upon which children in grades 1-3 make their evaluations 
of teachers. (See "^able 10) The largest of these factors is 
the one to be labeled "Stimulating Interactive Style". This 
quality involves both child-teacher rapport and teacher competence, 
for young children are apparently only in the process ot differ- 
entiating this factor into two components. If a four-factor 
solution is envoked for the data from grades 1-3, "competence 

'^Original items #1 and #2 were dropped from this final 
analysis for reasons discussed on page 63f . 



TABLE 10 



Primary (Highest) Loadings 
SET II Items — Three Factor Structure 
Grades 1-3 ' 



Factor 



Item No. Statement 



Loading 



Fafctor 1: 
Stimulating, 
Interactive Style 



'5 She maXes school fun. .94 

4 The kids like her. .85 

16 She likes us kids. .61 

13 She thinks we are a smart 







class. ' 


.71 
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She helps us a lot-. 






21- 


She thinks I have good 
ideas * 


.67 
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She listens to^what we want. 


.66 
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We can tell, how she wants 
things, don^. 


.65 




18 


, She thinks that kids are 
good. , 


.65 




17 


She likes to teach. 


.60 


Factor 2: 


8 


She* gets road a lot. 


.81 


Unreasonable 


22 


She thinks I am lazy. 


.77 


Negativity 


20 ' 


She thinks I act ugly. 


.73 


. 10 


She gives us too much work. 


.71 




. 6 


She always picks on people. 


.61 


Factor 3: 


15 


She likes me. 


.79 


Fostexrknce of 


12 


She thinks I am smart. 


.72 


Self-Es.teem 


14 


She thinks I can do a lot 
on my own. 


.71 




11 


.,She thinks I work hard. 


.63 




19 


She likes for me to help 
her. 


.59 
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items", .Item' No. 3 and 7 will, in fact, separate out from 
PactoS 1 (as they do at later ages along with Items 9 and 17) 

to form a separate factor. Thi%^dif f erentiation which occurs 

i 

progressively with age is roughly equivalent co the "love" and 

"competence" differentiation. The problem is that at the 

early ages "competence items", Icem No. 3 and 7, which will form 

a fourth factor, also take a pure rapport item (16) with them 

into the factor: the separation is inexact and not as clean as 

that which occurs at grades 4-6 (See Tables 11 and 12 which 

included grades 1--6, and Table 13 for a comparison of the structures.) 

It cannot be stressed too much, howev.er, that repeatedly in 

thesp data — regardless of age — ^the finding occurs that children's 

evaluation of a teacher {as here with "competence") is highly 

related to their belief about the teacher *s attitude toward them 

(as here with '^rapport*') • The blue card "projective" items 

(Items 11-22). whioh were planned to give a separate estimate of 

the child's belief about the teacher *s view of him. contained 

several items Vnlch were consistently and highly related to 

the child's more "objective" evaluation of the teacher herself 

(yellow card Items i-10) . Children's estimate Of a teacher's 

competence appears to be highly associated with the children's 

belief about the teacher's view of **heir competence. Also, 

whether children" think the teacher conducts a stimulating, pleasant 
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Factor Analysis of SET II 
Grades 1-6 
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TABLE 12 

Primary (Highest) Loadings 
of SET II Items--Four Factor Structure 
Grades 1-6 
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Rapport with Children 
(Factor 4, Table 9) 



actor : 



Item No. Statem.ent 



Loading 



Interactional Competence 
(Factor 3, Table 9) 



Unreasonable Negativity 
(Factor 2, Table 9) 



13 

• 4 
5 
16 
21 

18 



7 
3 

17 



8 
22 
20 
10 



Fosterance of Self-Esteem 15 
(Fadtor I, Table 9) 19 

12 
14 

V 

11 



She thinKs we are a 
smart class. 
The kids like her. 
She makes school fun. 
She likes us kids. 
She thinks I have good 
ideas . 

She thinks that kids 
are good. 

Sh^ listens to what we 
want. . 



She helps us a lot. 
We can tell how she 
wants things done. 
She likes to teach. 



She gets mad a lot. 
She thinks I am lazy. 
She thinks I act ugly. 
She gives us too much 
work. 

She always "picks on" 
people . 



.81 

.78 
.70 
.70 

.68 

.64 

.49 

.77 

.76 
.65 

.84 
,76 
.73 

.72 

.59 



She likes me. 

She likes for me to 

help her. 

She thinks I am smart. 
She thinks I can do a 
lot on my own. J 
She thinks I work hard, 



.80 

.74 
.73 

.69 
.61 



class appears closely tied to what the children believe their 
teacher's view is of their intelligence r and children *s report 
of their own self-es*teem appears to be highly related to whether 
they believe the teacher likes them or not. The apparent 
conclusion of these data — and probably the most important con- 
clusion — is that children seem to view teachers' behavior as 
a reaction o'f teachers to qualities in the children themselves. 
This line of thinking may indicate that remnants of early 
childhood ego-centric omnipotence remain in grades 1-5; but 

this attitude is also the beginning of wisdom. In other words, 

/ 

children at early ages appear to understand that they have 
a part an creating others' responses to themsel^^es or, at least, 
they sense that some causal relationship, exists between them- 
selves and teachers' responses. The danger is probably that 
children can 90 too far in this assumption. This may account 
for children's apparent confusion when teachers are excessively 
and unreasonably negative (Factor 2, to be discussed) as 
^children cannot "see" the basis for siich negativity. Much 
damage '«o a child's self-concept can result from assuming too 
much resi ons ibility for teachers' reactions. 

In conti'ast to Factor 1, the cohesiveness of Factor 2 and 
Factor 3 is quite stable across all age groups tested. These 
two 'factors are concerned with the unreasonably negative 



£oste« aevelopn,ent of inaividaal s.lf-estee.. Eviaently 
t.es. factors regain virtually unchanged across grades 1-6 
(Table 13) and are differentiated early. 

. ^re aetailea aiscussion of t.e content of the separate 
■factors will follow in the next section. ■ ^ 
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Factor I ; Stimulating, Interactive Style 

This factor is determined by a group of items which suggest 
that a lively, mutually respectful sense of rapport exists 
between teacher and student. The teacher makes school fun, the 
teacher and children like each other, and the teacher has a 
high regard for the children's intelligence.^ The flavor is 
essentially that of an egalitarian "with-it-ness*= such as 
can be observed often in the behavior of adults who direct child- 
ren's T^V. programs — for example. Sesame Street . The children 
and the teacher are mutually engaged in a pleasant, stimulating 
relationship in which the teacher does not '*talk down" to the 
children but expects. from them an intelligent degree of under-" 
standing. This is the sense of "love" or rapport/ which is 
suggested by these items. This sense of rapport is definitely 
compatible with that discussed extensively in ^the' Review of 
the Literature as a "generous, non-egocentric view of children" 



by the teacher. 

h 

The second "set" of items which loads upon Factor l/ at 
grades 1-3 are the items which chiefly concern the teacher's 



ERIC 



"^The relationship ot teacher- rapport and the teacher's ' 
supposed view of the children's intelligence is so strong that 
even Item #19, which is a self --eiSteem item stated in the first 
person, "crosses over" to load more heavily on Factor 1 than it 
does on Factor 3. The item is classified on the final form of 
the SET II upon Factor 3, where it logically belongs (and will 
appear with increased age) and where it also loads^ highly . 



competence, specifically the' success with which the teacher 
-interacts and communicates with the class.. These items are 
highly related to the rapport iteme of Factor 1 (discussed 
above) and, in fact, maintain much of this relationship 
even with increasing age and their eventual separation into 
another discrete factor. These items suggest that the 
teacher can both communicate her own intentions and listen 
emp^theticairy to the students; she helps the students a 
lot; and she likes to teach. These items definitely concern 
the act of teaching in its most attractive form^: the 
teacher and students are communicating, the^teacher is 
offering appropriate aid where the "gaps" exist, and the teacher 
gives 'the appearance o£,,deriving personal satisfaction from her 
part in the process. These items measure the same "with-it" 
quality that the rapport items measure, but they are less 
emotional and evaluative' and more competency-based. 

All items on Factor 1 suggest a high degree of successful 
student-teacher interaction. The "rapport" and "competence" 
items will separate with increasing age, and they may even be 
"viewed" separate on protocols of ^teachers in grades 1-3 
for any clinical insights they mav offer. But there appears 
to be only limited statistical justification for expecting these 
dimensions to exist separately in the minds of most first-third 



graders. That is the reason that Factor 1 is entitled- simply 
"Stimulating Inter-^ctive Style'* on the SET II when 4t is" used • 
with children below the third grade level. To view^the quality 
being measures as "simple"/ however, would be quite misleading. 

Factor II ; • Unreasonable Negativity 

The hypothesis was entertained in the Review of the Liter- 
ature section (this manual) that teacher rating Instruments do 
not tap sufficiently the child's strong reaction' to excessive 
emotional negativity in a teacher's behavior. Results of .the 
^ SET II data analysis suggest that this factor is even stronger ' 
than anticipated. (The item loadings on this factpr are 
presented in Tables 9 and 10.) . 

•*She gets mad a lot" determines this factor. Also primary ^ 
on Factor 2 are two items which^ express the child's belief that 
the teacher disapproves of his behavior., followed by two items 
which indicate that the teacher behaves in 'a punitive manner 
with the class. Not to be ignored is the -.51 loading on 
this factor of 'We can tell how she wants things done", 
Webster (Merrian-Webster .Seventh New Collegiate Dictionary, j 
1972)") discusses the term unreasonable as connoting "guidance 
" by some force other than reason (as self will, rage) that, makes 
one deficient in good sense" (see irrational , ^above 'reference)- 
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This seems precisely the quality children ^re reacting to in 
Factor 2. The teacher is guided by some 4orca other than 
reason, a. force which is not apparent to the children* The 
teacher is ' inscrutable to them* She explodes and punishes, but 
.they cannot ascertain whan it is that she wants* They indicate 
that she believes Lnem to be lazy and to act ugly. But behaving 
in a positive, competent manner does not seem to be related 
to the teacher ' s negativity (the lowest loadings on thi$ factor 
are fop tne three items of "She thinks I have good ideas, " 
"She tlmnks I work hard^" and "She^ tliiiiks I can do a lot on 
my own") • \ 

\ • ■ * ' 

The teacrver who is receiving high scores on this factor is 
clearly a mystery to children. Probably the reason that 
children react so strongly to this type of negative emotionality 
is that they cannot comprehend any rational basis for xts 
occurence. For this reason, the factor has been named "Unreason 
.ible Negativity It is not to be expected, however, that 
all openly emotionally-reactive teaghers will necessarily score 
very high on this factor (though that remains to be discovered). 
Children, are apparently tapping a more fearsome quality than 
simple emotionality on Factor 2: they see the anger, they feel 
the disapproval, and they incur the punishment; but they don't 

know what the impetus for su^h^ teach ar behavior can be. 

/ 



, Factor III : Fosterance of Self-Esteem 

' With the exception of the first item, a/tl items which load 

heavily on Factor 3 are items that cl^rly/ relate to personal. 

competence and self-esteem: She thinks /*! am smart..." ; 
"I can do a lot on my own "I work l>4rd»»; "She likes for 

me to help her and '^She thinks I ha/e good ideas The primary 

/ 

item on this factor, however, is "She/ likes me*'. The ^ . 

/ 

implied causal link is probably, *'Sh4 likes me because "I am^ 
smart^^and competent", etc. (What is more, this relation strength- 
ens rather than weakens with age.) As in Factor 1, a definite 
relationship exists factoric.lly between teacher behavior as 
the child observes it and what the child believes are his 
teacher's evaluations of his own intelli.-^nce and his ccir*petence . 
It is for this reason, plus the fact that this factor analysis 
is based upon teacher mean scores rather than aggregate indivi- 
dual student responses, that student self-esteem (as reported 
on the ^'blue card" items) is viewed as an interactive function 
of teacher behavior and the student's characteristics. In other 
words, differences in teacher mean scores on what might be viewed as 
purely personal, "projective" items cannot be accounted for 
by the nature of the students themselves. Something is aoirg 
on in. a cercain teacher's class when her students as a group 
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ts 



fee. better or worse about themselves than other studen 

feci about themsel^>es in ornnnc • „ 

in groups. This /■something-' is proposed 

^ as being the degree to which the teacher fosters the develop- 
ment Of an individual sense of self-esteem in children. The . 
first item on this factor is viewed as quite supportive of . 
this view. 



Final Form of the Experlmen^a1 sET II 
The final form of the SET II abandons . ny attempt to 
separate the student's more "objective" evaluation of the 
teacher fro. the students more "projective" attempt to estimate 
his teacher's supposed attitudes toward himself. That there 
appears to be no such separation in a child's evaluations (a. 
has.been discussed, is A important finding. Instead, the final 
form Of the SET II is presented in the three-factor format 
Which has be-en discussed, .u three factors involve inter- 
action between teacher ind student to some degree. 

curing the analyses, two items were dropped from the orig- 
inal twenty-two items, though Item «o. 1 is retained for its 
administrative function as a "wari-up" item. ^Both items provided 
Uttle information as the standard deviation of responses to 
th..e items was markedly lower' than for the responses to any 
other items (See Table 14 . U, . ,i,„, ^^.^ 
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TABLE 14 

Means and Standard Deviations: 
Pooled Student Responses All Items, 
Grades 1-3 and Grades 4-6 



Grad^S"l~3 
/Only : 



Grades 4-6 

inc . r 



Item: 

1 
2 



4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 



1.^04 
1.04 
1.27 

1. 10 
1.1-7 
1.79 
1.09 
1.7L 
1,37 
1.67 
1. 17 
1.11 
1.09 
1.15 
1.07 
1.10 
1.07 
1.12 
1.15 
'1.82 
1.21 
1.82 



SD*; 
.,19/ 

~7445 

.297 
- .379 
.404 
.282 
.455 
.489 
.470 
.375 
.316 
.290 
. 361 
.258 
.303 
.249 
.329 
. 361 
. 388 
.405 
.388 



M 

1.11 
1.08 
1.25 

1.29 
1.27 

l.e^ 

1.11 



57 
27 
55 
37 
31 
19 
1.25 
1.21 
1.13 
1.05 
1.20 
1.24 
1.74 
1.38 
1.77 



SD* 

.313 
.269 
.430 

.453 
.443 
.382 
.315 
.495 
.443 
.497 
.484 
.461 
.394 
.436 
. 40n 
. 336 
.208 
.402 
.429 
.437 
.486 
.422 



Item Statement: 

She teaches us a lot. 

She is a smart teacher. 

We can tell now she wants things 

done . 

The kids like her'.' 

She makes school fun. - 

She always picks on people. 

She helps us a lot. 

She gets mad a lot. 

She listens to what we v.dnt. 

She gives us too much work. 

She thinks I work hard. 

She thinks I am smart. 

She thinks we are a smart class. 

She thinks I can do a lot on my own 

She likes me. 

She likes us kids. 

She likes to teach. 

She thinks that kids are good. 

She likes for me to help her. 

She thinks I act ugly. 

She thinks I have good ideas. 

She thinks I am lazy. 



♦Standard Deviation 

T= Score of 1 
F= Score of 2 
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1 

2 
3 

4- 

5 

6 

7 

8 

9 

10 
11 

12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 



TABLE 15 

/■ 

Standardized Means: The Teacher Item Means 
All 36 Teachers, All 22 Items 



Item #: Item Statement: 



She teaches us a lot. 

She a smart teacher. 

we can tell how she' wants things 

done* 

The kids like her* 

She makes school fun. 

She always ''picks on" people. 

She helps us a lot. 

She gets mad a Ipt. 

She listens to what we want. 

She gives us too much work.. 

She thinks I work hard. 

She thinks I am smart. ^ 

She thinks we are a smart class. 

She thinks I can do a lot on my own. 

She likes me. 

She likes us kids* 

She likes to teach. 

She thinks that kids arc good. 

She likes for me to help her. 

She thinks I act ugly. , . 

She thinks I have good ideas. 

She thinks I am lazy. . 



M 



S .D.* 



1.15 


.144 


1.08 


.096 


1.23 


.136' 


1. 16 


. 181 


1.19 


. 198 


1.81 


. 150 


1.11 


.102 


1.68 


.186 


1.27 


.201 


1.62 


.163 


1.19 


.120 


1. 18 


.147 


1.14 


.136 


1. 18 


.115 


1. 14 


'. .12S 


1.13 


.123 


1.07 


.079 


1.19 


.164 


1.17 


.122 


1.76 


.146 


1.23 


.151 


1.78 


.148^ 



Note: T = Score of 1 
F = Score of 2 



^Standard Deviation 
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both items tended to distort the logical structure of many 
factor analyses performed with the two items included in - 
the analysis . Furthermore, a numbex' of teachers found 



Item No. 2 ("She is a sraart teacher*') to be offensive; and 
there Vas some indication that students at times used the 



item punitively rather than logically. Finally, it makes sense 
that children who have spent so few years in school demonstrate 
little variation in their responses to these two items. Their 
lack of experience with various teachers makes it difficult 
for them to teli whether a certain teacher is smart and/or 
teaches "a lot" or not. 

At older ages, responses to these two items become more 
diverse. ' But even then, the items do not load so highly with 
the teacher-competence items on Factor 1 as they do with the 
sti ent*s own self-esteem and competence on Factor 3. Taken 
together, the reasons above seemed sufficient for discarding 
the items as sources of useful information about teachers- 

The final form of the Experimental SET II is presented 



in Appendix D. 




CHAPTER V 
USING THE SET II 

The Experimental Version of the SET II is now available 
for use in research or teacher training programs. In the 
latter case. The SET II is viewed as appropriate for confront- 
ation (or feedback) counseling purposes as well as for eval- 
uation. Professional persons may arrange to obtain copies of 
the SET II for use in Grades 1-3 by using the following address 

SET II Order 

Disseminatio'i Department 
Research & Development Center 

for Teacher Education 
Educational Annex 
University of Texas 
Austin, Texas 78703 

Persons desiring to use the SET II with a population in 

Grades 4-6 may use the one-page form found in Appendix l * All 

persons who use the Experimental SET II are requested to share 

their data with The Research and Development Center for Teacher 

Education. This request is made in order chat norms may be 

developed for teaching behavior around the country. At present, 

such norms are not available. 

V 

In the absence of norms based upon a widely-distributed 
teacher population, groups who wish to use the SET II will 
presently need to develop their own norms. The normative data 
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contained in this manual (Table 16) may also be used as a refer- 
ence base when it is impossible for a' school group to develop 
Its own norms (for example.' in very sm^ll schools with few 
teachers) . In such cases /^extreme caution should be used in 
drawing conclusions, however, since the data contained in this 
manual are based upon responses to 36 teachers at most.' The 
primary purpose of the Pilot SET II study was the investigation 
of students' reliability of response. As more data are 
gathered by' further testing of the SET II, both normative 
findings and validation of the factor structure of the instru- 
ment will be pursued. \^ 
Using the SET II for Feedback Purposes \ 

The most common use of th"; .'ET II will probably be that of 
providing feedback to teachers so that they can evaluate their 
own effectiveness. The typical way to do this will be to 
discuss with the teacher her own profile of scores. Information 
for the profile will need to be derived in the following manner: 

A Teacher Tally Sheet is presented in Appendix E. Tally all 
the responses received by one teacher on a single tally sheet. ^ 
The total numJDer of positive and negative responses to each 
item will be recorded. The total negative scores and positive 
scores for all items in a single scale (based on the factor 



These responses come from the individual students' tally 
sheets. (See Appendix I.) 
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TABLE 16 



Standardized Scales 
20 Item SET II, 36 Teachers 



Snale I; 



q^nl.tina Inte_ractive_StYle, 



10.4764 
1.0789 
.17 98 
3.6020 



Mean 

Standard Deviation 
Standard Error of Mean 
Skewness Z. (P = -0006) 




TABLE 16 (cont.) 



Subscale: Rapport (or Scale 4, above third grade) 
5.7986 = Mean 

s 

\. 7172 = Standard Deviation 

.1195 = Standard Error of Mean 
3.9207 Skewness (P = .0003) 



Kaw Score 


Frequency 


Percentage 


Percentile 


Standard 


Normal 


5.02 


•2 


6 


3 


39 


31 


5.09 


i' 


3 


7 


40 


35 


5.16 


5 


14 


15 


41 


'40 


5.23 


2 


6 


25 ' 


42 


43 


, 5.37 


2 


6 


31 


44 


45 


5.44 


1 


3 


35 


45 


46 


5.51 


1 


3 


37 


46 


47 


5.58 


4 


11 


44 


47 


49 


5 . 65 


3 


8 


54 


48 


51 


, 5.72 


3 


8 


63 


49 


53 


5.79 


1 


3 


68 


50 


55 


6.08 


1 * 


3 


71 


54 


55 


6.15 


2 


6 


75 . 


55 


57 


6.22 


3 


8 


82 


56 


59 


6.36 


1 


3 


88 


58 ' 


62 


6.85 


1 


3 


90 


65 


63 


7.07 


1 

* 


3 


93 


68 


65 . 


7.77 




3 


96 ' 


78 




8.13 


3 


99 


83 


— 











TABLE 16 (con t.) 

Subscale; . In teractiona l competenr^^ (or Scale 1, abpve 
third grade) ^ 

4.6778 = Mean [ 
.4284 - Standard Deviation \ 
.0714 = Standard Error of Mean 

3.7100 = Skewness Z, (P = .0005) 



Raw Score Frequency Percentage Percentile Standard 



Normal 



4.04 


2 


6 


3 


35 


31 


4.12 


1 


3 


7 


37 


35 


4.21 


3 


8 


13 


39 


38 


4.29 


1 


3 


18 


41 


41 


4.42 


2 


6 


22 


44 


42 


4.46 


2 


6 


28 


45 : 


44 


4.50 


1 


3 


32 


46 


45 


4.55 


2 


6 


36 


47 


I 46 


4.59 


■ 1 


3 


40 


48 . ., 


48 


4.63 


2 


6 


44 


49 


49 


4.67 , 


6 • 


17 


56 


50 


51 


4 .72 ' 


2 


6 


67 


. 51 


54 


4.80 


2 


6 ■ 


72" • 


53 


56, 


4.88 


1 • 


3 


76' 


' 55 


57 


4.93 


2 


6 


81 


56 


59 


5.01 


1 


3 , ^ 


85 


58 


60 


5.10 


1 


3 


88 


60 


62 


5.14 


2 


6 


92 


61 


64 


5.48 


1 


3 


96 


69 


67 


6.32 


1 


3 


99 


89 


72 
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TABLE 16 (cont.) 



Scale p. 




8.6608 
.63^5- 
. 1064 

-•5599 



Mean 

Standard Deviation 
Standard Error of ^ean 
Skewness z, (p = .5327) 



\ 
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TABLE 16 ,(cont.) 



Scale 3j 



Fosteranc^^i_Sel£^^ 



7.0944 
.6343r 
.105.7 

2.1760 



Mean 

-Standard Deviation 
Standard Error of Mean 
Skewness'z, (P =-0277) 



Raw Score Frequency 



6.21 
6.28 
6.40 
6.46 
6.65 
6.71 
6.84 
6.90 
6 . 96 
■ 1 .03 
7.15 
7.28 
7.34 
7.40 
7.46 
7.53 
7.71 
7.78 
8.03 
8.09 
8.59 
8.84 



2 
1 
3 

2 
3 
1 
4 
2 



1 

1 

2 

1 

2, 

3 

1 

1 

1 

1 

1 

1 

1 

1 



Percentage 

6 
3 
8 
6 

8 . 
3 
11 
6 

3 - 
3 

6 
3 
6 
8 
3 
3 
3 
3 
3 
3 
3 
3 



Percentile- 



Standard Normal 



3 
7 

13 
19. 
26 
32 
39 
47 
51 
,54 
/58 
63 
•67 
74 
79 
. 82 
8S 
88 
90 
93 
96 
99 



36 


31 ^ 


37 


35 


39 


38 


40 


41 


43 ' 


44 


44 


45 


46 


47 


47 ^ 


- 49 


.48 


50 


49 


51 


51 


52 


53 


53 


54 


54 


• 55 ' 


56 


56 


58 


S7 


59 


60 


60 


. 61 


62 


65 


63 


66 


65 


74 


67 


^ 78 


72 



structures described earlier) may*^then he added together 
What relsults is ^e 'total score for , each scale • /(Use the 
£Dur-f actor form for Grades 4-6.).. ^ 

/Each of a teacher^^s scale' totals (there will T:>e' 3 or 4)*^ 
can then' be divided by the. number of students in the teacher's 

class v;ho responded tp the instrument. This operation yields 

* * 

the teacher's mean (or average) scmle- scores for each scale. 

i -' 6 • 

Normative dat^ for ah entire teacher group should then be 

generated by using all the individual teachers* mean'^scale 

scores as/the scores to be manipulated. From these teacher 

# ^ 

mean scores, a teacher group mean and teacher group standard 
deviation . (i.e. , "norms") can be derived for each- factor. 

* (See Appendix K ) 

These teacher group norms will be posted in parentheses 
on the Teacher Profile Form (See Teacher ' Prof ile Form, Appendix 
G) . After ^the teacher * s .own ^scale scores have 'also been posted 
on the profile, in the open blanks; the completed profile can 
used to provide feedback to the -teacher herself. 

6 "Tocher group" = The total number of teachers being test 
which sh^id be at least 25-30. 

^If professional help fs not available locally to complete 
the generation cf school group norms, see Appendix K for a 
method of computing these normative scores to be placed in the 
parentheses on the Profile Forms. 



Use- of the SET II in Research 
— — j-^ — 1 

Scoring the SET II is essentially the same as describe'd 
above. In research activities, of course, computer programming 
is. usually available to perform the tasks. The use of teacher 
mean scores in data analyses is strongly suggested so that the' 
emergence of c.ny logical structure which may ^xist in students' 
patterns of responses i:r best d^^raged. 

At pres->nt. Item No. 2 ,is not used in the card system. 
The former Item 1 ("She teaches us a lot^T is used for admin- 
istrative purposes but not scored. As a next step in develop- 
ment of" the SET II. two new items are now proposed to replace ol 
Items No. 1 and 2. Both of these items are to be adBiinistered. 
to be recorded c;- "part of the teacher's tally sheet, but not 
to be included ir, scoring. It is hoped both items will, event- 
ually bolster the "interactional competence" dimension; and 

if 

when sufficient data have been gathered to determine whether 
the 'items are functionina as intended, they will be incorpo.- 
ated into the scoring of the SET II or repUced, whichever i- 
indicated. The now items are: 

2: She makes what we learn inceresting. 
No. 23: She is nice when we make mistakes. 



/ 



Communication regarding the SET II is invited. Please 
contact. Dr. Ruth A. Haak at the Research and Development Center 
for Teacher Education, The University of Texas, Austin, Texas 
78712. 



APPENDIX A 



She thinks 
that k ids are 
godd . 




She thinks I 



have good ideas. 




She 1 ikes me . 




She likes to 
teach . 



She thinks I 
work hard. 



She likes us 
kids. 






79 



APPENDIX C ' 

Besides the factor analyses which are presented in this ' s 
manual, the following analyses were performed and are .available 
from the author on request: 

1. Factor Analysis; Grades 2 & 3 (All). 

2. Factor Analysis-. Grades 1-3 White 

3. Factor Analysis: Grades 1-3", Ability 2-3, Mexican- 
American 

4. Factor Analysis: Grades 1-3, Ability 2-3, Black 

5. Factor Analysis: First 10 Items, Grades 2-3, Black 

6. Factor Analysis: First 10 Itenls, Grades 2-3, 
Mexican- American 

7. Factor Analysis: First 10 Items, Grades 2-3, White 

8. Factor Analysis: First 10 Items, Grades 4-6, 
Mexican- American 

9. Factor Analysis: Last 12 Items, Grades 2-3, Black 

10. Factor Analysis: Last 12 Items, Grades 2-3, 
Mexican- American 

11. Factor Analysis: Last 12 Items, Grades 2-3, White 

12. Factor Analysis: Last 12 Items, Grades 4-6, 
Mexican- American 



id 



APPENDIX D 
The Factor Structure of th^ GET II 
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Stilaula tinq. Interactive Shy l^. 



Item 



4 
16 
13 
18 



7 
9 
3 

17 



Subsca3 Rapport 

She makes school fun. 
The kids like her. 
She likes us kids. 
She thinks we are ^ smart class, 
She thinks kids ^re good. 



Subscale: 




eractional Competence 



She helps us a lot. 

She listens to what we want. 

We can tell how she wants things done. 

She likes to teach. 



Unreasonable Negativity : 
Item 



8 

22 
20 
10 
6 



She gets mad a lot. 

She thinks I am lazy. 

She thinks I act ugly. 

She gives us too much work. 

She always "picks on" people, 



KIC 



III. Fosterance of Self-Ssteem : 
Item 



15 
12 
14 
11 

19 
21 



She Ixkes me. 

She thinks I am smart. 

She thinks I can do a lot on my own 

She thinks I wc-rk hard. 

She likes for me to help her. 

She thinks I have good ideas. 



*For 'clinical or counseling use only at Grades 1-3 
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Instructions : 



Teacher 



APPENDIX E 

Teacher Tally Sheet 

All the individual student's scorxng records for 
one teacher should be posted on this sheet. 



Grade 



_Date^ 





True {T 


=1) 


False (F= 


= 2) 




Tally 


Score 


Tally 


Score 


stimulating. Interaction Style: 






s 




Item 




; 






5 She makes school fun* 










4 The kids like her. 










15 She likes us kids. 


1 








She thinks we are a 
13 smart class , 










18 She thinks kids are good. 











*Subscore: 



Total Rapport 



(T) 



(F) = 



^Subtotal :^ 



(Scale Mean Score) 



7 She helps us a lot. 

She listens to vhat we 
9 want. 

We can tell how she wants 
3 things done. 
17 She likes to teach. 



*Subscore : 



Total Interactional 
Competence 



































(T)= 1 (F) = 
•*Sub total: 
-4- N V 



(Scale Mean ^Score) 
Scale Total 



r N = 



( Scale Mean Score) 



New Items: 



erJc 



2 She makes what we learn interesting, (tally only) 
23 She is nice- when we make mistakes. (tally only)^ 



APPENDIX E (cont.) 



True (T=^l) False (F^2) 



1 1 . Unr easonable Negativity 
Item : 

8 She gets mad a lot* 
22 She thinks I am lazy. 
20 She thinks I act ugly. 
10 She gives us too much work. 

6 She always ''picks" on people. 



Tally 


Score 


Tally 


Score 








































— 








., . ■■ 





T= F= 



Scale Total — . 

4N 

(Scale Mean Score) 

ill. Fosterance of Self-Esteem 



Item: 

15 She likes me. 

12 She thinks I am smart. 

14 She thinks I cah do a l-^t 

on my own. 
11 She thinks I work hard. 
19 She likes for me to 

help her. 
21 She thinks T have good 

ideas . 

r 



1 1 






, — 






1 








1 












I 


h 



Scale Total ^ ^ 

^ >3 ____ 

(Scale Mean Score) 



x*fvj=r number of students who rated thi.i teacher. 
* For clinical or counseling use only at Grades 1-3, At Grades 4 
and above, use as separate scale scores. ( Rapport becomes the 
name of Scale 4, Interactional Coyetence the name of Scale 1.) 
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BMM . APPENDIX F 

Teacher Tally Sheet 

InstriLcU^ns: All the individual student's scoring records for 

one teacher should bo por^ted on this Hheet. 

Teacher 

^^I^i^it^ ^Grado 0^ De^te }<^-^0~ IH. 



I. ; Stimulating, Interactjj 



I tern 



She makes school fun. 
The kids like hec. . 
She likes us kids. 
She thinks we are a 
smart class. 

She thinks kids are good. 
*Subscore: Total Rapport 



4 
15 

13 
18 



True (T=l) 


False (F=2) 


Tally 


Score 


Tally ■ 


Score 


1 








htm HH- 


AT 












fO 


mmmn 




III 


fo 






nil 


8 


Ml mill 






*SuKtotal ■_JjiM^__ 



(Scale Mean Score) 



7 She helps us a lot. 

She listens to whot we 
9 want. 

We can teli how she wants 
3 things done. 
17 She likes to teach. 

^Subseoro: T>tal Interactional 
Competence 







mi 








/<■" 


m- 


lO 


ttii (tii Jilt 


















(T) = 


*SubtOtc'l : 





erJc 



ScaU> Total 
( ScaJc Moan Score) 



r 

fn\ TfrT" 



^ She ina\os what wo leirn mt uros! inci . (t.llv otAv) 0- 
23 . 1. nice when v. make mistakes. (t, u; ...nlv)i^7^;,/ 



APPKNDIX F (cont.) | 



II. Unreasonable Ncnativity : 
Item 

8 She gets mad a lot. 
22 She thinks I am Lazy. 
20 She thinks I act ugly. 
iO She gives us too much work 
^She always ''picks on" 

6 people.* 



True (T^-l) 
' Tally Score 



False (F=2) 



ml 

tl_ 

m 



I 



Tally 



Score 



3^ 



m m mini 



39 



1^ 



Scale Total 
(Scale Mean Score) 



{F) = /7^ 

jj^L. ^ 



III* Fosterance of relf-Estoem t 
Item 

She likes me. 
She thinks I am smart. 
She thinks I can do a 
lot on my own. 
She thinks I work hard. 
She likes for mc to help 
19 her. 

She thinks I have good 
21 ideas. 



15 
12 

14 
11 



liilutii 11 lit 
uxSJaJIxLl. 






111/ ! 




! llUiUiUUMi' 

i wwn.m.mj- 


J_Z2_ 










m-mm4 




1 


2- 




! .12.. 


±\\ 


^,1 



(T)= ;<99 



{F)=2:2. 



Sc. lie Total 
-f- N = 



131 



(Scale Mean Score) 
NunsLor ul ntudcnLs v,ho rated this tCQclicr . 



*For c'linicnl or counseling use only at orador. l-.:. At Grades 4 
a.^. above, use as separate scale scores. (.R^ort becomes 
S<:<=i^* 4, inter notional C ompetence rr.mai-ns Scale 1.) 
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APPENDIX G 



Name ^ -Grade Date 



Teacher's three scores may be placed yon this profile to 
give a picture of her comparative str-^ngths and weaknesses. 



+ 3S 



+ 2S 



+ IS 



M 



IS 



-23 



-3S 



-4- 



Teacher Profile {For Grades 1-3) 



o ^/ 



CO 



u c 
^ ( 



e ( 



-rr 
O 
c 



o 



Group Mean 
Standard 
Deviation 

Scale : 



S timulating^ 
interactive 
. Style 



( 



s 



CO 



-FT 
O 
C 



TJ 



( 



O 4v 



M O 
CP 



O 



o 



Unreasonable 
Negative ty 



Fosterance of 
Self--Esteem 



*Figures are to be filled in' from local norms, based upon 
a sufficient numberi^of subjects. 

NOTE: Since T-T ,and 2=F in scoring the SET II, the meaning 
of each scale score must be interpreted carefully. On 
Scales 1 and 3, a high mathematical score has a negative 
connotation^ On Scale 2, a high mathematical score has 
a positive connotation. To avoid unnecessary confusion in 
using this SET II Profile for counseling purposes, post the 
norm figures for ALL SCALES from high at the bottom 
of the profile to . low on top of the profile. This makes 
the interpretation of alj. scales easier, as each scale 
score which appears ^bove the mean then carries with it a 
co^^^ation that this is a "high'\ score on that scale — 
whichLs the usual case in test interpretation. 



EXAMPLE 
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APPENDIX H 



r 



Name 



Grado 



_^L__Dat e/c^-30-742> 



picture of her comparaUive strengths and weaknesses. 

v5 



Teacher Profile (For Grades 1^3) 
' ' — — ^ , 




Groi:;:) Mean 
S Landa]^d 
DcviaLion 

Scale: 



Stimulating, 
Interactive 
Style 



Unreasonable 
Nogal,--Vxty 



FosterancG of 
Self-Esteem 



*Fiylu-c. arc to be filled in from local norms, basod upon 
u 3Uificient number of subjects. ^ 



"ion/"' '"^ ^"-^ scoring' the SET II, the mean inn 



score must ')e interpreted carefully 



On 



NOTE: 

of each sctiio 

. -^-i!^--;. pj. tjuuy care 

Scales 1 ana 3, a high mat, omaticaL score has a '.o^.M.. 
connotation. On Scale high mathom^tL 1^^ 'tl 

us?.^r hl^ SrHJI --™^^y conlusiSn in 

usi.,g thi. bLI II Profile i^or counsoling ourposes post the 

o^th Tof iio^'o f " iii'Vat.\.hrki?^ 

M?. -—^--^^ '^""^-^ profile. This makes 



each scale 



the interpretation of 'all scales easio- o< 
score which appears .above the moan thon^car^^o. with i, 

T.aTf."n ''''' f^'^ ^ ^corS-on that ^ca^e-- 

which IS the usual case m test interpretation. 



,er!c 
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■■•kPPKJDIX I 
SET II pupil's Scoring Record 



Instructions 



Record the way the s-tudent sorted his cards upon this sheet 
as the ccirds are pulled from the sorting envelope, 

St\fdent's Name — ^ Grade Date 



Stimulating. Interactive Style : 

1 tern True False 

5 She makes school fun. ^. (T=l) (F=2)_ 

4 The kids like her. (T^l), (F-2)_ 

16 '"She likes us kids. (T=l) {F=2)„ 

13 She thinks we are^ a smart x;lass.(T=l) ^ {F=2)_ 

18 She thinks kids are good. ". {T=l) (F==2)_ 

. ^ *Subscore: . Rapport. {T=l) {F=2)_ 



7 She helps us a lot. ' {T=l) (F=2)_ 

9 She listens to what we Wc it. (T=l); {F=2) 

We can 'tell how she wants. things 

3: done. • . (T=l) (F = 2). 

17 She likes, to teach. • ' (T=^l) (F=2) 

*Subscore: Interactional 

'--J competence - (T=l) (F=2). 



Scale Total: (T) + (F) = 



'New Items; 
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2 ^,She makes what we learn interesting. (tally only) 

23 She is nice when wjc^ make mistakes. (tally only) 
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APPEND LX I (cont..) 



II. iJnreasor.able Negativity. : 
• Item " ' 



She gets mad a lot. ' {T=l) l 

She thinks I am i-azy. {'T=l).: — _ 

She thinks I'act ugly. f <T=1) \^Zi\ 

10" She gives us too much work. , ''^"•■l-^-^ 'Z-ll 

.4 She always "picks on" people. (T=l)- (F-2) 

Scaie Total:,, (T) + (F) = _ 



9 

22 She thinks I am iazy 

20 



XII. Fn.gtgr ance of Self-Esteem ; . ' 

"■'-.*_ i 
Item ' . . ' ! 

15 She likes'm'e. (T=l) (F=2) 

12 She thinks I am smart. <T-1) (^7^' 

■ Sh«=^ thinks J. can' do a lot on 

{T=l) (F-^) 



14 my own. 

li 
19 

21 ■ ■ 



She thinks I work hard. (T^l).^ . (F-2) 

She likes for me to help her. {T=l) [ (F=2) 

She .thinks. 'jr. h-a\ie>^^:aed ideas . {T=l) (F=-2) 

'^"^ ' Scale Total:'- (T) + (F) = ^ 

*For clinical or couniseling use only at Grades 1-3. At Grades 
and aboye, use as separate scale scores. ( Rapport becomes 
Scale 4, In'teractinnal Competence remains 'Scale 1.) 
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APPffiJDIX J 

SET II Pupil's Scoring Record 
( Example ) 



Instructions ! 



a. hvf^-^ the student sorte'd his cards' upon "this sheet 

as the cards are pulled from the sorting envelope. 

Student's Nan^e OS^^^Jz^^.J:^. prade.^ Dat e /j^-.^^^^^. 



\ 



Stimula ting. Interactive Style : " ' ' * 

Item _ 

^ . ■ Jrue Fals e ' 

5 She makes school fun. ' " (T=l) (F-2) 

4 ^ The kids li1te het, - (T=l)~ {fZi)"^ 

I liJ^es ps kids. (T=l) {F=2) ~Z^ 

, ■ thinks/ we are a ^ smart class. (T=1) ~V^" (F=2) ' 

T thinks kids are good. (T=l)l2Z (F=2) " 



*Subscbre: Rapport .(T=l) ^ (F?2) ^ 

7 ■ . She helps us a lot. (T=l) - (F=2) 

9 - She' listens to what we want. , (T=l) (F^2) ~~^ 

We can tell how she wants things 

,^ (T=l) \y {F=2)_ 

'^ne likes to teach. (T-l)- (F=2) \X 

*Subscore: Interactional ' 

Competence (T=l) JL- (F=2) ^ 

^ f 

I Scale Total: (T) + (F) = '/^ 



New Items; 



. \ 



.• ? . makes what- we learn interestin'g . ' (tally only ) ^ 

. is nice when we make mistakes. . ' (tally onl yjj^ 
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■APPENDIX J (cont.) 



II- Unreasonable NeaaMvi^y. 
Item 



• 8 . ^ . She gets mac^. a lot. ' '(T=l) (F=2) 

22 She thinks I am lazy. (T-1) y/ (F=2) 

20 She thinks I act ugly. , (T=l) (F=2) 

^0 She gives us too much work. (T=l) ^/ (F=2)__ 

6 She always "picks,, on"' people. (T=l)' (F=2) ""C^ 

Scale Total I (t) + = 7 



iii)s 



Fosterance of Self-Esteem ; 
Item 

t 

• \ She likes me. (T=l) J {F---.2) J 

12 ' She thinks l aai^smart. (T=l) y/" (F=2) 

• ^ ' , She thinks I can do a lot on ~ ~ 

14 ' . my own. (T=l) (F=--2) J 

11 She thipks l work hard. (T=l) (F=2) ~ty 

19 She likes for me to help her.. (T=l) ^ (F=2) 

She' thinks I have good ideas. (T=l) >/ (F-2) 

^ 'Scale Total-: ' {^) (F) = JP 

V*For clinical or counseling use only at Grades 1-3. At Grades 4 
. and above,. use as separate scale scores. ( Rapport becomes 
Scale 4, Interactional Competenrff remains Scale 1.) 



. APPENDIX K . - 

Computing Norms 

In order to compare a teacher's perfO"rmance to some set ^ 

! ' \ . ^ 

of standards, it is necessary to know what the standards are* 

In psychological testing, such standards are referred to as ' 

"norms The two basic norms vhich are needed for use in interr 

preting performance on th# SJE^ II scales are a total group mean (the 

average score for the entire group)' and, a "total group standard 

(deviation (a figure whi(^h shows how much spread there is in the 

scores; this spread is measured at standard interval on a typical 

"bell curve*' distribution and is called the "standard deviation") . 

Wxth the SET II, •a mean and standard deviation is needed 

for the performance of the, group on each scafle* This means 

that with data from third grade or below, threes scale means 

\ 

and three scale standard' deviations need to be computed for 
the entire group, If^ the data originates from fourth graders 
or above, four sets of such scores are needed. (See structure 
of the Experimental SET II, Table ^ i - ' 

0 ^ , If computational service^s are not available to- a 'School, 
the following operations will provide, a way to derive the - 
necessary figures. 



JiK^ Factor Mearvs , 

' ' ■/ 
' First,' complete ^ Tally .Sheet for each teacher (See, 

AppendiK F) .Carry outfall steps on the' tally sheet. This will 

result in a set of scale scores^ for ^ each teacher. Be surea^l 

the -teacher tally sheets are complete.. To establish norms, 

now begin to work with one scale at a time. In other words, 

compute- alL figures 5or all teachers o^ Scale 1\ then repeat 

for Scale 2, etc> The following, example illustrates the pro- ^ 

cess of establishing the group mean for Scal^ 1: 

Example; Scale 1 (6 Tea .hers*) 



Teacher ; 

Alice A. 
Betty B/ 
Cora C. 
Don D* 
Elbert E. 
Fred F. 



I 



S cale I Total Score;^ t 

^ 17.49 

15.40 ' 
' 14.32 - 
^ 12,75 
^ 11.63 
^ 9.41 * 



Grand Total 81.00 ^ - 

After all teachers' Scale 1 sqores have been added to- 
gether, divide this grand total by the nunber of teachers in- 
volved; . ' 

81.00 6 = 13.-50 

^ * 

The group mean score for Factor 1 is 13.50. 
Repeat this process for Scale 2 and Scale 3' (and 
Scale 4,' if above third grade). 



*Six is too few to compute reliable norms and is used here 
only for illustration., ... 
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S.tandard Deviations 

■• In computing, the "standard deviations Jot each scale, 

again work r^ith one icale at a, time. The following steps/ whi'ch 

are illustrated using f ictitious Jata in the tabl^ below, can ' 

be followed in comCTting each standard deviation. 

Ste£_J,. List all teachers' scale scores, for-- t-he scale in 

question. 

From eac-h teacher ' s scale score subtract the group 
mean, that you have just -dompu ted. This procedure • 
yields a "deviation from the mean" score for each 
teacher. '{Some of <the.*deviations will be Negative. 
All minus signs can be ignored.) " 

Square all of the deviations; obtained in Step 2. 
This ^ives a "squared deviation" score for ea'ch 
teacher . " . - * ' 

Sum all the squared deviations obtained in Step 3. ' 

Divide th-e sura obtained in Step 4 by ti?e number of 
-teachers. (E.g.- If there are 34 teacher scale scores 
listed in Step 1, divide the sum obtained in Step 4 ■ 
- by 34.) ' - 

\ 

Find the" square root of the number obtained in Step 
5. This is the standard deviation. (Consult a -table- 
of square roots to derive this figure,) • . " 



Step 2 



Step 3 

Step 4 . 
St^p 5. 



Step 6 . 



Illustration 



Teachers^ 

1. Alice^A- 

2. Betty B, 

3. Cora C. 
4* ' Don D. 

5* Elbert E. 
6. Fred F. 



Scale --Scores 

17,49 
15.40 
14.32 . 
- 12.75 
11.63 
9.^1 



Deviations ^ Squared Deviati ons 



Total 

Group Mean 



81.00 



3.99 
1.90 
0.82 
-0.75 
-1.87 
-4.09 



15.92 
3.61 
*.67 
.56 
3.50 
16.73 , 

40.99 



• ^ r- _ 

= 81-r 6 = "13.50 Standard Deviation =J 40.99 =-- /fi.»^=? ei 
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J. 



The general formula for finding the standard .deviation is: 

. S-, 



where S.D, stands for standard deviation 



means "the sum of , " 



9t ;'j.means the Squared deviations^ and N is *the number of teach ers\ 

Whfen the group -mean and group standard deviation are com- 
pleted for Scale 1, repeat the process for the pther scales • 
What results will -be the norm^ needed to post upon the Teacher 
Profile {see Appendix H) , also as in the following illustration: 
Alice A*-^ 



•4-3S .c ksm * 

+2S St(84f)_ 




Teacher -Profile (For Grades 1-3) 

.. A ^ 

Cn 



^ ( ) 'S (' I 



CP 



if 



)l 



M O 



M O 

-Sloi ^- 

g ( ) 



If 



y) { ) 

Q > 



M O 



e 0 ) 



/ 



Alice h.lfHo 



USJZ) 



-jr 
n 
o 



C ') 



TT 



c* ) 



c ) 



m 

n. X i. 



Group Mean . 
Standard 
Deviation 

Scale:' 



Stimulating', 
Interactive 
Style 



Unreasonable Fosterancc^ of 
Negativity Self-Este6m 



(1) Post the group mean score. ^ . ^ 

(2) Add the standard deviation. to the mean score one time 
for 1 S.D., two times for 2 S*D.^ /three times for ^ 

3 S^B* • 

(3) Subtract the standard deviation from, the Jne^n score ^ 
once for -1 S-^D.v twice 'for -2 S.D,/ and three times 
for -3 S-iD. 

(4) Post the teacher's own- factor scores on ^he chart. 



4 
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T^e 'Teacher Profile is ^now reatiy fcr^u&e in eouDseling or 

feedbacft activities. 

An example of six such teacher profiles, from teachers 
who were included* in the present sc^mple, is presented, in 
Appendix M. ' • 



I 



M 
I 

I 



f 
m 

m o 



APl^ENDIX t • . ■ 
t . 

Form for. Use with Grades Above 4' 



Set II ' (4H-) 
Your Name J 



Date 



Your Teacher 



YOUR TEACHER 



School 



' Do vou really notice how vour t eacher acts?. 
' Please raarK the following sentences ab^^fe your teacher. 
Tell if each sentence is true or false- by putting an K under T or 
F. Be Honest. Your teacher will NOT see *hese answers. 




) 
)■ 
) 
) 
) 



) 

J 



She |.t caches ui a lot.' 

The kids like her. * 

She listens to What we want. 

She makes what we learn interesting. 

She always picks on people; > 

. * ■ 

Sfte helps us a lot. 

She gives us too' much work. 

We can tell how she wants things done. 

She .gets mad a lot. 

She makes school fun. ;* ' 



She likes to teach 

She thinks that kids are good. 

She thinks P work hard. 

She thinks I have goo# ideas. 

She likes/^s kids. 



/ 



She likes me. * ' ^ I 

She likes'^fof me to h^p he^.// - . 
She thittks I cap do a lot on my own. 
She thinks I am lazy. / 
She^ thinks I act 'ugly. /. 



She thinks we are a smart class. 

She thinks^ I am smart. / 

She is nice when we make mistakes. 

^ . . - / ^ ^ ^ 



*Thds form subsiAtutes for the cal^ sorting format used belowr 
grade 4. This form should still be read aloud by the examiner 
when u^ed with any group which may include a number of poor 
readers-* . . - 



I 



' Appendix M 

A COMP^OIISON OF SIX TEACHERS ' PROF ILEa^ 
(Members of This- Samp 1©^^ 



97 



TEACHER PROFILE 




SCeLle 1: 
SfiMtlLATING, 
INTERACTIVE 
STYLE 



Scale 2; " 

UNREASONABLE 

NB3AT1VITY 



Scale 3: 
FOSTERANCE , 
OF 

SELF-ESTEEM 



Key; 



Teacher A Sixth ^^de feeacher , 
* ^ B Second grade teacher 
C - PCdrth grade teacher. 
D Sixth grade teacher 
E First grade teacher 
F -Fourth' grade teacher 



of Educati 
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SET 2 COMPUTER PROGRAM 
MANUAL 



by 



'4 



i 



Bob Pennington 



The SET2 program was written to provide detailed 'feedback concerning 
students^ evaluation of their teacher* Data used by the SET2 program is 
provided by the Student Evaluation of Teacher Instrument .II (SET .II),. 
developed by Haak* Kleiber, and Peck. of the Research and Development 
Center for Teacher Education, A copy of the SET •!! manual may be obtained 
by contacting one of the authors. 

The SET *li contains 22items, twenty of^which comprise three scale 
scores and two.subscale scores. The items which cor spond to eaah scale 
*are: 



R-apport Subscore 

Interactional Competence Subscore 
Stimulating. Interactive Style Scale Score 
Unreasonable Negativity ScMe Score 
Fosterance of Self-Esteem Scale Score 



5, 16', 13, 18 

7, 9, 3, 17 ^' 
R Subscore -f ic Subscore 

8, 22, 20, 10, 6 

IS, 12, 14, 11, 19, 21 



INPUT . . r 



Header Card . A Header card is required for each teacher.,^ The 
card includes the number of students participating in. the evaluatiorv 
and a sixty column space Usually used to convey or record information 
or identification of the teacher. Different classes may be run for 
each teacher sequentially but a header card is necessary for each 
class. The format for the header card is (IS,10A6). > . , 

Data Card . There is one data card for each student. The'^ firsir 
forty columns are yot rc?ad by the SET2 program and can thus be us^d to 
identify students In any number of ways. Columns forty-one »throufeh, 



sixty contain twenty one-digit SET .II iscores* These scores are either 

a "1" or a "2" indi^^aj?lhg *'true" or "false" respectively. ^The data 

card format is (40X,20Fi) . \ - * ' ; 

Deck Arrang;emeht . Tiie header, card followed by the a^^propriate 

number of data cards constituti^s a set of data. Any number of sets 

can be processed under the restraints of time and papery allocation 

The last set of data processed must: be followed by a blank card. 

When conpleted the deck should resemble the following: . ^ 

Header Card for Teacher / 

Data Cards of Teacher's students 



Header Card for Teacher 

Dlta Card for Teacher* a students 



Blank Card. \, 



I 



OUTPUT 



The header card (KH) is outputed along with(the class number (KC) 

\ \ 

and the number of students in the class (N) . After the item means have 
been tabulated they are outputed vertically with the mean for each item 
following the item number. The three scale scores and, the two subscores 
are then computed and outputed following the item means 

i ' 

Appended to this manual are copies of the program listing, program 
flowchart;, an^^program output* . The author wishes to express his appre- 



ciation to Dr, Doug Kleiber^,who developed the original SET2 program* 
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